Shannon’s Formula and Hartley’s Rule: A Mathematical Coincidence?
نویسندگان
چکیده
Shannon’s formula C = 2 log(1+P/N) is the emblematic expression for the information capacity of a communication channel. Hartley’s name is often associated with it, owing to Hartley’s rule: counting the highest possible number of distinguishable values for a given amplitude A and precision ±D yields a similar expression C0 = log(1+ A/D). In the information theory community, the following “historical” statements are generally well accepted: (1) Hartley put forth his rule twenty years before Shannon; (2) Shannon’s formula as a fundamental tradeoff between transmission rate, bandwidth, and signal-to-noise ratio came unexpected in 1948; (3) Hartley’s rule is an imprecise relation while Shannon’s formula is exact; (4) Hartley’s expression is not an appropriate formula for the capacity of a communication channel. We show that all these four statements are questionable, if not wrong.
منابع مشابه
On Shannon's Formula and Hartley's Rule: Beyond the Mathematical Coincidence
In the information theory community, the following “historical” statements are generally well accepted: (1) Hartley did put forth his rule twenty years before Shannon; (2) Shannon’s formula as a fundamental tradeoff between transmission rate, bandwidth, and signal-to-noise ratio came out unexpected in 1948; (3) Hartley’s rule is inexact while Shannon’s formula is characteristic of the additive ...
متن کاملSubjective Information Measure and Rate Fidelity Theory
Using fish-covering model, this paper intuitively explains how to extend Hartley’s information formula to the generalized information formula step by step for measuring subjective information: metrical information (such as conveyed by thermometers), sensory information (such as conveyed by color vision), and semantic information (such as conveyed by weather forecasts). The pivotal step is to di...
متن کاملA Measure of Information
Modern information theory is founded on the ideas of Hartley and Shannon, amongst others. From a practitioners standpoint, Shannon’s probabilistic framework carries certain impediments for the practical measurement of information, such as requiring á priori knowledge of a source’s characteristics. Moreover, such a statistical formulation of entropy is an asymptotic limit, meaningful only within...
متن کاملOn optimal fuzzy best proximity coincidence points of fuzzy order preserving proximal Ψ(σ, α)-lower-bounding asymptotically contractive mappings in non-Archimedean fuzzy metric spaces
This paper discusses some convergence properties in fuzzy ordered proximal approaches defined by [Formula: see text]-sequences of pairs, where [Formula: see text] is a surjective self-mapping and [Formula: see text] where Aand Bare nonempty subsets of and abstract nonempty set X and [Formula: see text] is a partially ordered non-Archimedean fuzzy metric space which is endowed with a fuzzy metri...
متن کاملShannon's entropy revisited
I consider the effect of a finite sample size on the entropy of a sample of independent events. I propose formula for entropy which satisfies Shannon’s axioms, and which reduces to Shannon’s entropy when sample size is infinite. I discuss the physical meaning of the difference between two formulas, including some practical implications, such as maximum achievable channel utilization, and minimu...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2014